Method and system for testing and monitoring a real-time streaming media recognition service provider

ABSTRACT

A computer system obtains a streaming media signal source, selects a testing sample from the streaming media signal source, records characteristics of the testing sample, and obtains an expected output according to the characteristics of the testing sample. Next, the computer system converts the testing sample into a digital streaming format preset by a service provider and initiates a media recognition request according to the testing sample in the digital streaming format to the service provider. After receiving a media recognition result of the testing sample returned by the service provider according to the media recognition request, the computer system compares the media recognition result with the expected output and indicates whether the service provider is normal in accordance with the comparison result.

RELATED APPLICATION

This application is a continuation application of PCT Patent ApplicationNo. PCT/CN2015/081331, entitled “METHOD AND SYSTEM FOR TESTING ANDMONITORING A REAL-TIME STREAMING MEDIA RECOGNITION SERVICE PROVIDER”filed on Jun. 12, 2015, which claims priority to Chinese PatentApplication No. 201410327529.4, entitled “METHOD AND SYSTEM FOR TESTINGAND MONITORING A REAL-TIME STREAMING MEDIA RECOGNITION SERVICE PROVIDER”filed on Jul. 10, 2014, both of which are incorporated by reference intheir entirety.

TECHNICAL FIELD

The present application relates to multimedia technologies, and inparticular, to method and system for testing and monitoring a real-timestreaming media recognition service provider.

BACKGROUND

Streaming media are audio, image, video, text and multimedia filestransmitted in a network in a manner of streaming. The network refers toa wired broadcasting network, a wireless broadcasting network, theInternet and the like. A streaming media file format is a media formatthat supports streaming transmission and playing.

Real-time streaming media usually use streaming transmission. Thestreaming transmission is to compress multimedia files such as video andinto separate compressed packages that are continuously transmitted to acomputer by a server in real time. In a system using streamingtransmission, to view content of a file, a user does not need to waituntil the file is completely downloaded as the user does duringnon-streaming playing. Instead, after a few seconds or dozens of secondsof startup delay, the user can play the streaming media file such ascompressed video or audio on a computer with a corresponding player, andthe rest part will be continuously downloaded until the playing iscompleted.

A conventional system for testing and monitoring streaming media usefixed testing samples and output results that can be used repeatedly.However, in a real-time streaming media recognition service provider,because the streaming media changes in real time, whether a testingsample is effective depends on time. A corresponding result can berecognized in an effective time window, while the testing sample becomesineffective out of the time window. The real-time streaming mediarecognition service provider cannot return an expected recognizingresult, and therefore, whether functions and stability of the real-timestreaming media recognition service provider are normal cannot bedetermined.

SUMMARY

The above deficiencies and other problems associated with theconventional approach of testing and monitoring the function andperformance of a real-time streaming media recognition service providerare reduced or eliminated by the invention disclosed below. In someembodiments, the present application is implemented in a computer system(e.g., computer server, etc.) that has one or more processors, memoryand one or more modules, programs or sets of instructions stored in thememory for performing multiple functions. Instructions for performingthese functions may be included in a computer program product configuredfor execution by one or more processors and stored in a non-transitorycomputer readable medium.

One aspect of the present application involves a computer-implementedmethod of testing and monitoring a real-time streaming media recognitionservice provider performed at a computer system. The computer systemobtains a streaming media signal source, selects a testing sample fromthe streaming media signal source, records characteristics of thetesting sample, and obtains an expected output according to thecharacteristics of the testing sample. Next, the computer systemconverts the testing sample into a digital streaming format preset bythe service provider and initiates a media recognition request accordingto the testing sample in the digital streaming format to the serviceprovider. After receiving a media recognition result of the testingsample returned by the service provider according to the mediarecognition request, the computer system compares the media recognitionresult with the expected output and indicates whether the serviceprovider is normal in accordance with the comparison result.

Another aspect of the present application involves a computer systemincluding memory, one or more processors, and one or more programmodules stored in the memory and configured for execution by the one ormore processors to perform the method described above.

Yet another aspect of the present application involves a non-transitorycomputer readable storage medium having stored therein one or moreprograms for execution by one or more processors of a computer system.The one or more programs include instructions, when executed by the oneor more processors, cause the processors to perform the operations asdescribed above.

BRIEF DESCRIPTION OF THE DRAWINGS

The aforementioned features and advantages of the invention as well asadditional features and advantages thereof will be more clearlyunderstood hereinafter as a result of a detailed description ofpreferred embodiments when taken in conjunction with the drawings.

FIG. 1 is a flowchart of a method for testing and monitoring a real-timestreaming media recognition service provider in an embodiment;

FIG. 2 is a structural block diagram of a system for testing andmonitoring a real-time streaming media recognition service provider inan embodiment;

FIG. 3 is a schematic diagram of interaction between a system fortesting and monitoring a real-time streaming media recognition serviceprovider and a real-time streaming media recognition service provider;and

FIG. 4 is a schematic diagram of a system for testing and monitoring areal-time streaming media recognition service provider when applied to atelevision.

Like reference numerals refer to corresponding parts throughout theseveral views of the drawings.

DESCRIPTION OF EMBODIMENTS

Reference will now be made in detail to embodiments, examples of whichare illustrated in the accompanying drawings. In the following detaileddescription, numerous specific details are set forth in order to providea thorough understanding of the subject matter presented herein. But itwill be apparent to one skilled in the art that the subject matter maybe practiced without these specific details. In other instances,well-known methods, procedures, components, and circuits have not beendescribed in detail so as not to unnecessarily obscure aspects of theembodiments.

In order to make the objectives, technical solutions, and advantages ofthe present application easier to understand, the present application isdescribed in further detail in the following with reference to theaccompanying drawings and the embodiments. It should be understood that,the specific embodiments described here are only used to explain thepresent application, but are not used to limit the present application.

Today, more and more people use different client-side electronic devices(e.g., desktop, laptop, tablet and smartphones) to receive real-timeinformation (e.g., news, a sports game) from online service providersthrough streaming media services offered by the online serviceproviders. Because of the diverse nature of these client-side devicesand the real-time fashion of the Internet environment, the onlineservice providers need to monitor the quality of such streaming mediaservices in real time, identify issues experienced by any client-sidedevices and fix the issues as quickly as possible. The presentapplication is directed to a method of testing and monitoring thefunction and performance of a real-time streaming media recognitionservice provider and a system implementing the method. Using such methodand system, the operator of the real-time streaming media recognitionservice provider can identify and solve an issue experienced by itscustomers before the issue escalates into a significant problem or evena disaster in terms of user experience.

FIG. 1 is a flowchart of a method for testing and monitoring a real-timestreaming media recognition service provider in an embodiment. As shownin FIG. 1, the method for testing a real-time streaming mediarecognition service provider includes the following steps:

Step 102: Obtain a streaming media signal source, select a testingsample from the streaming media signal source, and recordcharacteristics of the testing sample.

Specifically, a real-time streaming media signal source is obtained,where the streaming media signal source may be a signal source capturedfrom a television or radio or by other capturing devices.

After the obtaining a streaming media signal source, the method furtherincludes: converting the testing sample into a digital streaming formatpreset by a real-time streaming media service. In some embodiments, eachdigital streaming format is supported by a predefined set of client-sidedevices. The system rotates among a set of digital streaming formats toperform the testing and monitoring operations to make sure that thereal-time streaming media service provider support as many client-sidedevices of different types as possible. In some embodiments, the systemrandomly selects one digital streaming format to perform the testing andmonitoring operations. In other embodiments, the system follows apredefined order to perform the testing and monitoring operations fordifferent digital streaming formats.

The streaming media signal source may be a signal source such astelevision audio, an image screenshot or radio audio. The streamingmedia signal source is converted into a digital streaming format presetby the real-time streaming media service. The converted signal sourcemay be audio of a certain length, one or more image screenshots, or anextracted feature value of audio or an image. Then, a streaming mediasegment is selected from the converted streaming media signal source,and is used as a testing sample for testing and monitoring, andidentification information such as an attribute and an identifier of thetesting sample is recorded.

The testing sample refers to streaming media data input to a real-timestreaming media recognition service provider. The real-time streamingmedia recognition service provider is a background service system whichprocesses streaming media in a backend server, recognizes certaininformation from streaming media information, and provides more specificrecognizing information. For specific content types of differentstreaming media, the system can recognize different streaming media suchas audio, video, multimedia, and text. Testing refers to a systemenvironment for verifying actual functions and performance of thereal-time streaming media recognition service provider before releasingits service. Monitoring refers to a system environment for monitoringand tracking stability of the real-time streaming media recognitionservice provider and issuing fault alarms after releasing its service.

The recorded characteristics of the testing sample include theattributes and identifier of the testing sample. Attributes of differenttesting samples are different. For example, if a testing sample istelevision audio, the attributes include time when the television audiois extracted, length and size of the television audio, televisionchannel information of the extracted television audio, a source of theextracted television audio and the like. The identifier is used foruniquely identifying a testing sample, such as television channelinformation.

In the method for testing and monitoring for a real-time streaming mediarecognition service provider, the step of selecting a testing samplefrom the streaming media signal source includes: selecting the testingsample from the streaming media signal source at a preset time interval.Specifically, the preset time interval may be set as required, forexample, 10 seconds or 15 seconds.

Step 104: Initiate a media recognition request according to the testingsample to a real-time streaming media recognition service provider, andreceive a media recognition result of the testing sample returnedaccording to the media recognition request.

In this embodiment, the step of initiating a media recognition requestaccording to the testing sample includes: initiating the mediarecognition request according to the testing sample by complying with aclient request protocol of the real-time streaming media recognitionservice provider.

A program is used to a simulate a client of the real-time streamingmedia recognition service provider, so as to originate the mediarecognition request for a backend real-time streaming media recognitionservice provider and receive the returned media recognition result,which avoids dependence on hardware equipment, in addition, a protocolformat and command used by the media recognition request are consistentwith those of the client, so as to ensure that the real-time streamingmedia recognition service provider can receive and process themcorrectly. Content included in the media recognition result differs fordifferent testing samples. For example, if the testing sample istelevision audio, the media recognition result may include a value oftelevision channel information and the like; if the testing sample isradio audio, the media recognition result may include a value of radiochannel information, for example, the number corresponding to an 88.8 Hzradio channel is 0001.

Step 106: Obtain an expected output according to characteristics of thetesting sample, and compare the media recognition result with theexpected output; if the two are same, indicate that the real-timestreaming media recognition service provider is normal; otherwise,indicate that the real-time streaming media recognition service provideris abnormal.

In this embodiment, the recorded characteristics of the testing sampleinclude the attribute and identifier of the testing sample. Theattribute and identifier of the media recognition result are comparedwith the recorded attribute and identifier of the testing sample. Ifthey are same, it indicates that the real-time streaming mediarecognition service provider is normal; otherwise, it indicates that thereal-time streaming media recognition service provider is abnormal.Herein, the service being normal means that functions and stability ofthe real-time streaming media recognition service provider are normal,and the service being abnormal means that functions and stability of thereal-time streaming media recognition service provider are in anabnormal state.

The expected output refers to a preset result that is expected to beobtained according to the testing sample after testing. For example, ifthe testing sample is television audio, attribute content of thetelevision audio includes time when the television audio is extracted(for example, extraction starts at 15:30:20, Jun. 24, 2014), length oftelevision audio (10 seconds), size (20 kilobytes), television channelinformation of the extracted television audio, and a source of theextracted television audio. The television channel information is usedas an identifier of the television audio, and the identifier is used asa value for determining the expected output of the television audio. Forexample, if the testing sample is radio audio, attribute content of theradio audio includes time when the radio audio is extracted (forexample, extraction starts at 15:30:20, Jun. 24, 2014), length of radioaudio (10 seconds), size (20 kilobytes), radio channel information ofthe extracted radio audio, and a source of the extracted radio audio.The radio channel information is used as an identifier of the radioaudio, and the identifier is used as a value for determining theexpected output of the radio audio. The returned media recognitionresult is a value of television audio information, and the returnedvalue of the television audio information is compared with an expectedvalue of the television audio information. If the two are same, itindicates that the real-time streaming media recognition serviceprovider is normal; otherwise, it indicates that the real-time streamingmedia recognition service provider is abnormal.

Specifically, for example, the testing sample is television audio. Ifthe television channel to be tested is CCTV-1 and a corresponding IDnumber of CCTV-1 in the real-time streaming media recognition service is001, the system 200 for testing and monitoring a real-time streamingmedia recognition service provider is connected to a CCTV-1 channeltelevision signal source (a cable television signal or a satellitetelevision signal), uses a real-time streaming media recognition serviceto extract a feature of the television signal source, and captures clips(for example, 3 seconds, 5 seconds or 8 seconds) of the extractedfeature of the television signal source by a length of the feature audioclips (which may be a preset length) captured by the client of thereal-time streaming media recognition service. A simulated client of thereal-time streaming media recognition service sends the extractedfeature of the fixed length to the real-time streaming media recognitionservice according to a preset protocol, and receives the result returnedby the real-time streaming media recognition service provider. Becauseit is known that the signal source for the testing sample is the CCTV-1channel, the expected output of the testing is the ID number 001 of theCCTV-1 channel. When the received ID number in the media recognitionresult returned by the real-time streaming media recognition serviceprovider is 001, the media recognition result is consistent with theexpected output, which indicates that the real-time streaming mediarecognition service provider correctly recognizes the testing sample. Ifthe ID number in the media recognition result is not 001, the mediarecognition result is inconsistent with the expected output, whichindicates that the real-time streaming media recognition serviceprovider fails to recognize the testing sample correctly. Similarly, byusing different television signal sources, extracting features, andusing the features as testing samples, whether the real-time streamingmedia recognition service provider can accurately recognize a program ofeach television channel can be verified one by one, so as to meetrecognizing and monitoring requirements.

In the method for testing and monitoring a real-time streaming mediarecognition service provider, a testing sample is selected from astreaming media signal source, the testing sample is analyzed to obtaina media recognition result, and the media recognition result is comparedwith an expected output of the testing sample, and if the two are same,it indicates that the real-time streaming media recognition serviceprovider is normal. A segment of streaming media is extracted from thereal-time streaming media signal source to generate the testing sample,the expected output of the testing sample is recorded, and the mediarecognition result is compared with the expected output, which achievesreal-time testing and monitoring of the real-time streaming mediarecognition service provider and ensures that functions and stability ofthe real-time streaming media recognition service provider are in anormal state.

FIG. 2 is a structural block diagram of a system 200 for testing andmonitoring a real-time streaming media recognition service provider inan embodiment. The system 200 for testing and monitoring a real-timestreaming media recognition service provider includes a real-timestreaming media obtaining and processing module 220, a client simulatingmodule 240 and a media recognition result determining module 260. Insome embodiments, the system 200 includes one or more processors, memoryand a system bus. Various system components including the memory and theprocessors are connected to the system bus. The processors are hardwarefor executing computer program instructions through basic arithmetic andlogic operations in the computer system. The memory is a physical devicefor temporarily or permanently storing computer programs or data (forexample, program state information). The system bus may be any one ofthe following types of bus structures: a storage bus or storagecontroller, a peripheral bus and a local bus. The processors and thememory may perform data communication with a streaming media signalsource and/or real-time streaming media service provider through thesystem bus. The memory includes a non-transitory computer readablemedium such as read-only memory (ROM) or a flash memory (both notshown), and random access memory (RAM), where the RAM generally refersto a main memory loaded with an operating system and applicationprograms.

The real-time streaming media obtaining and processing module 220 isconfigured to obtain a streaming media signal source, select a testingsample from the streaming media signal source, and recordcharacteristics of the testing sample.

The real-time streaming media obtaining and processing module 220 isfurther configured to convert the testing sample into a digitalstreaming format preset by the real-time streaming media service.

The streaming media signal source may be a signal source such astelevision audio, an image screenshot or radio audio. The streamingmedia signal source is converted into a digital streaming format presetby the real-time streaming media service. The converted signal sourcemay be audio of a certain length, one or more image screenshots, or anextracted feature value of audio or an image. Then, a streaming mediasegment is selected from the converted streaming media signal source,and is used as a testing sample for testing and monitoring, andidentification information such as an attribute and an identifier of thetesting sample is recorded.

The testing sample refers to streaming media data input to a real-timestreaming media recognition service provider. The real-time streamingmedia recognition service provider is a background service system Whichprocesses streaming media in a backend server, recognizes certaininformation from streaming media information, and provides more specificrecognizing information. For specific content types of differentstreaming media, the system can recognize different streaming media suchas audio, video, multimedia, and text. Testing refers to a systemenvironment for verifying actual functions and performance of thereal-time streaming media recognition service provider before releasingits service. Monitoring refers to a system environment for monitoringand tracking stability of the real-time streaming media recognitionservice provider and issuing fault alarms after releasing its service.

The recorded characteristics of the testing sample include theattributes and identifier of the testing sample. Attributes of differenttesting samples are different. For example, if a testing sample istelevision audio, the attributes include time when the feature isextracted, length and size of feature audio, television channelinformation of the extracted feature, a source of the extracted signaland the like. The identifier is used for uniquely identifying a testingsample, such as television channel information.

The real-time streaming media obtaining and processing module 220 isfurther configured to select the testing sample from the streaming mediasignal source at a preset time interval. Specifically, the preset timeinterval may be set as required, for example, 10 seconds or 15 seconds.

The client simulating module 240 is configured to initiate a mediarecognition request according to the testing sample, and receive a mediarecognition result of the testing sample returned according to the mediarecognition request.

The client simulating module 240 is further configured to initiate themedia recognition request according to the testing sample by complyingwith a client request protocol of the real-time streaming mediarecognition service provider.

A program is used to a simulate a client of the real-time streamingmedia recognition service provider, so as to originate the mediarecognition request for a backend real-time streaming media recognitionservice provider and receive the returned media recognition result,which avoids dependence on hardware equipment. In addition, a protocolformat and command used by the media recognition request are consistentwith those of the client, so as to ensure that the real-time streamingmedia recognition service provider can receive and process themcorrectly.

The media recognizing result determining module 260 is configured toobtain an expected output according to the characteristics of thetesting sample, and compare the media recognition result with theexpected output. If the two are same, it indicates that the real-timestreaming media recognition service provider is normal; otherwise, itindicates that the real-time streaming media recognition serviceprovider is abnormal.

In this embodiment, the recorded characteristics of the testing sampleinclude the attribute and identifier of the testing sample. The mediarecognizing result determining module 260 is further configured tocompare the attribute and identifier of the media recognition resultwith the recorded attribute and identifier of the testing sample. Ifthey are same, it indicates that the real-time streaming mediarecognition service provider is normal; otherwise, it indicates that thereal-time streaming media recognition service provider is abnormal.Herein, the service being normal means that functions and stability ofthe real-time streaming media recognition service provider are normal,and the service being abnormal means that functions and stability of thereal-time streaming media recognition service provider are in anabnormal state.

In the system 200 for testing and monitoring a real-time streaming mediarecognition service provider, a testing sample is selected from astreaming media signal source, the testing sample is analyzed to obtaina media recognition result, and the media recognition result is comparedwith an expected output of the testing sample, and if the two are same,it indicates that the real-time streaming media recognition serviceprovider is normal. A segment of streaming media is extracted from thereal-time streaming media signal source to generate the testing sample,the expected output of the testing sample is recorded, and the mediarecognition result is compared with the expected output, which achievesreal-time testing and monitoring of the real-time streaming mediarecognition service provider and ensures that functions and stability ofthe real-time streaming media recognition service provider are in anormal state.

Besides, whether the media recognition result of the testing sample isconsistent with the expected output can also be verified by manuallyusing a real client of the real-time streaming media recognition serviceprovider to perform functional operations.

FIG. 3 is a schematic diagram of interaction between a system 200 fortesting and monitoring a real-time streaming media recognition serviceprovider and a real-time streaming media recognition service provider300. In FIG. 3, a client simulating module 240 in the system 200 fortesting and monitoring a real-time streaming media recognition serviceprovider initiates a media recognition request towards the real-timestreaming media recognition service provider 300 using a selectedtesting sample, and receives a media recognition result of the testingsample generated by the real-time streaming media recognition serviceprovider 300. A media recognition result determining module 260 isconfigured to compare the media recognition result of the testing samplewith an expected output of the testing sample. If the two are same, itindicates that the real-time streaming media recognition serviceprovider 300 recognizes normally; otherwise, it indicates that thereal-time streaming media recognition service provider 300 recognizesabnormally, and the returned media recognition result needs to betracked and recorded for analysis.

FIG. 4 is a schematic diagram of a system 200 for testing and monitoringa real-time streaming media recognition service provider when it isapplied to a television. In FIG. 4, a television 400 provides areal-time streaming media signal source; a real-time streaming mediaobtaining and processing module 220 obtains the real-time streamingmedia signal source (such as audio), and converts the audio according toa format preset by a real-time streaming media recognition serviceprovider; a segment of the audio is selected from the convertedreal-time streaming media signal source as a testing sample; the testingsample is sent to a client simulating module 240; the client simulatingmodule 240 initiates a media recognition request towards a real-timestreaming media recognition service provider 300 according to thetesting sample, and receives a media recognition result of the testingsample made by the real-time streaming media recognition serviceprovider. A media recognition result determining module 260 isconfigured to compare the media recognition result of the testing samplewith an expected output of the testing sample. If the two are same, itindicates that the real-time streaming media recognition serviceprovider 300 recognizes normally; otherwise, it indicates that thereal-time streaming media recognition service provider 300 recognizesabnormally, and the returned media recognition result needs to betracked and recorded for analysis.

Besides, the system 200 for testing and monitoring a real-time streamingmedia recognition service provider may also be applied to a radiostation, network streaming media video and the like.

A person of ordinary skill in the art may understand that all or a partof the processes for implementing the foregoing method embodiments maybe completed by related hardware according to instructions of a computerprogram. The program may be stored in a computer readable storagemedium. For example, in the embodiments of the present application, theprogram may be stored in a storage medium of a computer system, and isexecuted by at least one processor of the computer system to implementthe processes of the method embodiments. The storage medium may be amagnetic disk, an optical disc, a Read-Only Memory (ROM), a RandomAccess Memory (RAM) or the like.

While particular embodiments are described above, it will be understoodit is not intended to limit the invention to these particularembodiments. On the contrary, the invention includes alternatives,modifications and equivalents that are within the spirit and scope ofthe appended claims. Numerous specific details are set forth in order toprovide a thorough understanding of the subject matter presented herein.But it will be apparent to one of ordinary skill in the art that thesubject matter may be practiced without these specific details. In otherinstances, well-known methods, procedures, components, and circuits havenot been described in detail so as not to unnecessarily obscure aspectsof the embodiments.

The terminology used in the description of the invention herein is forthe purpose of describing particular embodiments only and is notintended to be limiting of the invention. As used in the description ofthe invention and the appended claims, the singular forms “a,” “an,” and“the” are intended to include the plural forms as well, unless thecontext clearly indicates otherwise. It will also be understood that theterm “and/or” as used herein refers to and encompasses any and allpossible combinations of one or more of the associated listed items. Itwill be further understood that the terms “includes,” “including,”“comprises,” and/or “comprising,” when used in this specification,specify the presence of stated features, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, operations, elements, components, and/or groups thereof.

As used herein, the term “if” may be construed to mean “when” or “upon”or “in response to determining” or “in accordance with a determination”or “in response to detecting,” that a stated condition precedent istrue, depending on the context. Similarly, the phrase “if it isdetermined [that a stated condition precedent is true]” or “if [a statedcondition precedent is true]” or “when [a stated condition precedent istrue]” may be construed to mean “upon determining” or “in response todetermining” or “in accordance with a determination” or “upon detecting”or “in response to detecting” that the stated condition precedent istrue, depending on the context.

Although some of the various drawings illustrate a number of logicalstages in a particular order, stages that are not order dependent may bereordered and other stages may be combined or broken out. While somereordering or other groupings are specifically mentioned, others will beobvious to those of ordinary skill in the art and so do not present anexhaustive list of alternatives. Moreover, it should be recognized thatthe stages could be implemented in hardware, firmware, software or anycombination thereof.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussion above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, to therebyenable others skilled in the art to best utilize the invention andvarious embodiments with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. A method of testing and monitoring a real-timestreaming media recognition service provider, the method comprising: ata computer system having one or more processors and memory for storingprograms to be executed by the one or more processors: obtaining astreaming media signal source; selecting a testing sample from thestreaming media signal source; recording characteristics of the testingsample; obtaining an expected output according to the characteristics ofthe testing sample; converting the testing sample into a digitalstreaming format preset by the real-time streaming media serviceprovider; initiating a media recognition request according to thetesting sample in the digital streaming format to the real-timestreaming media recognition service provider; receiving a mediarecognition result of the testing sample returned by the real-timestreaming media recognition service provider according to the mediarecognition request; comparing the media recognition result with theexpected output; indicating whether the real-time streaming mediarecognition service provider is normal in accordance with the comparisonresult.
 2. The method of claim 1, wherein the testing sample is selectedfrom the streaming media signal source at a preset time interval.
 3. Themethod of claim 1, wherein the digital streaming format is supported bya predefined set of client-side electronic devices.
 4. The method ofclaim 3, wherein the media recognition request is a simulation of arequest from one of the predefined set of client-side electronic devicessupporting the digital streaming format.
 5. The method of claim 3,wherein the real-time streaming media recognition service provider isnormal when the media recognition result is the same as the expectedoutput and the real-time streaming media recognition service provider isabnormal when the media recognition result is different from theexpected output.
 6. The method of claim 1, wherein the testing sample isone selected from the group consisting of television audio, an imagescreenshot, and radio audio, and the recorded characteristics of thetesting sample include a predefined set of attributes of the testingsample including time when the testing sample is extracted, length andsize of the testing sample.
 7. A computer system, comprising: one ormore processors; memory; and one or more program modules stored in thememory, wherein the one or more program modules include instructions tobe executed by the one or more processors, the instructions furtherincluding: obtaining a streaming media signal source; selecting atesting sample from the streaming media signal source; recordingcharacteristics of the testing sample; obtaining an expected outputaccording to the characteristics of the testing sample; converting thetesting sample into a digital streaming format preset by the real-timestreaming media service provider; initiating a media recognition requestaccording to the testing sample in the digital streaming format to thereal-time streaming media recognition service provider; receiving amedia recognition result of the testing sample returned by the real-timestreaming media recognition service provider according to the mediarecognition request; comparing the media recognition result with theexpected output; indicating whether the real-time streaming mediarecognition service provider is normal in accordance with the comparisonresult.
 8. The computer system of claim 7, wherein the testing sample isselected from the streaming media signal source at a preset timeinterval.
 9. The computer system of claim 7, wherein the digitalstreaming format is supported by a predefined set of client-sideelectronic devices.
 10. The computer system of claim 9, wherein themedia recognition request is a simulation of a request from one of thepredefined set of client-side electronic devices supporting the digitalstreaming format.
 11. The computer system of claim 7, wherein thereal-time streaming media recognition service provider is normal whenthe media recognition result is the same as the expected output and thereal-time streaming media recognition service provider is abnormal whenthe media recognition result is different from the expected output. 12.The computer system of claim 7, wherein the testing sample is oneselected from the group consisting of television audio, an imagescreenshot, and radio audio, and the recorded characteristics of thetesting sample include a predefined set of attributes of the testingsample including time when the testing sample is extracted, length andsize of the testing sample.
 13. A non-transitory computer readablestorage medium storing one or more program modules, the one or moreprogram modules comprising instructions, which, when executed by one ormore processors of a computer system, cause the processors to performoperations including: obtaining a streaming media signal source;selecting a testing sample from the streaming media signal source;recording characteristics of the testing sample; obtaining an expectedoutput according to the characteristics of the testing sample;converting the testing sample into a digital streaming format preset bythe real-time streaming media service provider; initiating a mediarecognition request according to the testing sample in the digitalstreaming format to the real-time streaming media recognition serviceprovider; receiving a media recognition result of the testing samplereturned by the real-time streaming media recognition service provideraccording to the media recognition request; comparing the mediarecognition result with the expected output; indicating whether thereal-time streaming media recognition service provider is normal inaccordance with the comparison result.
 14. The non-transitory computerreadable storage medium of claim 13, wherein the testing sample isselected from the streaming media signal source at a preset timeinterval.
 15. The non-transitory computer readable storage medium ofclaim 13, wherein the digital streaming format is supported by apredefined set of client-side electronic devices.
 16. The non-transitorycomputer readable storage medium of claim 15, wherein the mediarecognition request is a simulation of a request from one of thepredefined set of client-side electronic devices supporting the digitalstreaming format.
 17. The non-transitory computer readable storagemedium of claim 13, wherein the real-time streaming media recognitionservice provider is normal when the media recognition result is the sameas the expected output and the real-time streaming media recognitionservice provider is abnormal when the media recognition result isdifferent from the expected output.